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Outline. This document is organized as follows. Section 1 presents an extended 
abstract of the dissertation containing research context, description of the aims of 
the dissertation, discussion of the new results, their validation, impact and dis- 
semination, and information about financial support. Section 2 contains notation, 
brief summary of the chapters of the dissertation (definitions, duality concepts and 
minimax state estimation algorithms), conclusions, list of papers and conference 
presentations related to the dissertation and list of papers cited in the text. 



1 Extended abstract of the dissertation 

Research context. Differential- Algebraic equations (DAE) are widely used in 
engineering. In vehicle dynamics, DAEs represent a convenient and powerful basis 
for software modeling platforms (see for instance the platform Modelica). DAEs 
are also used in mathematical economics, robotics, biomechanics, image processing 
and control theory. In this context, the analysis of DAE is an important issue in 
the framework of mathematical systems and control theory. One of key problems of 
mathematical systems theory is so-called state estimation, that is to construct an 
estimate of the state, given observations of the state of the process being modeled. 
The dissertation is devoted to the development of the mathematical theory and 
algorithms for state estimation problems for linear DAE. The main mathematical 
tool is the Minimax State Estimation (MSE) approach. Main assumptions behind 
MSE are 1) the model is represented by a system of differential equations (for 
instance, system of Ordinary Differential Equations (ODE) or Partial Differential 
Equations (PDE)), 2) hnks between the model and observed data are represented 
by observation equation and 3) uncertain parameters (for instance, error in initial 
condition or model error or noise in the observed data) belong to a given bounding 
set. In other words, the uncertainties in the model and observed data are described 
in terms of the bounding set. The main idea behind MSE is to describe how the 
model propagates uncertain parameters which are consistent with observed data and 
belong to the given bounding set. 

Main notions of MSE are reachability set, minimax estimate and worst-case error. 
By definition, reachability set contains all states of the model which are consis- 
tent with observed data and uncertainty description. Given a point P within the 
reachability set one defines a worst-case error as the maximal distance between 
P and other points of the reachability set. Then the minimax estimate of the 
state is defined as a point minimizing the worst-case error (a Tchebysheff center 
of the RS). Basics of the MSE were developed by Bertsekas and Rhodes [1971], 
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Milanese and Tempo [1985], Kuntsevich and Lychak [1992], Chernousko [1994], Kurzhans 
[1997], Nakonechny [2004]. 

In the case of linear model, given a bounding set the classical MSE allows to 
construct the minimax estimate for the state of the model and calculate the worst- 
case estimation error, provided the model operator is bounded and has a bounded 
inverse. The classical MSE is based on the Kalman Duality principle which states 
that the state estimation problem is equivalent to a dual optimization problem, 
provided the model operator is bounded and has a bounded inverse. However, 
linear DAEs do not fit this framework as the corresponding model operator may 
not be invertible or may have unbounded inverse. Therefore, the classical duality 
concept was not applicable for derivation of the MSE theory for linear DAEs. 

Aim of the dissertation. The aim of the dissertation is to develop a general- 
ized Kalman Duality concept applicable for linear unbounded non-invertible oper- 
ators and introduce the minimax state estimation theory and algorithms for linear 
differential-algebraic equations. In particular, the dissertation pursues the following 
goals: 

• develop generalized duality concept for the minimax state estimation theory 
for DAEs with unknown but bounded model error and random observation 
noise with unknown but bounded correlation operator; 

• derive the minimax state estimation theory for linear DAEs with unknown 
but bounded model error and random observation noise with unknown but 
bounded correlation operator; 

• describe how the DAE model propagates uncertain parameters; 

• estimate the worst-case error; 

• construct fast estimation algorithms in the form of filters; 

• develop a tool for model vahdation, that is to assess how good the model 
describes observed phenomena. 

New results. The dissertation contains the following new results: 

• generalized version of the Kalman duality principle is proposed allowing to 
handle unbounded linear model operators with non-trivial null-space; 

• new definitions of the minimax estimates for DAEs based on the generalized 
Kalman duality principle are proposed; 
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• theorems of existence for minimax estimates are proved; 

• new minimax state estimation algorithms (in the form of filter and in the 
variational form) for DAE are proposed. 

Validation and impact. In order to validate the Generalized Kalman Duality 
(GKD) concept I applied it Zhuk [2005b, 2006c] to linear incorrect differential oper- 
ators (see Tikhonov and Arsenin [1977] for further details on incorrect problems). 
As a consequence, I constructed new minimax state estimation algorithms for linear 
DAE and linear Boundary Value Problems (EVP) for ODE. The main impact is 
that the new minimax estimate for DAE does not require regularity assumptions 
on DAE structure (regularity of the matrix pencil Hanke [1989] or rank-degree con- 
dition Dai [1989]), imposed by the majority of authors; the minimax estimate for 
EVP works without restricting the structure of the corresponding ODE matrices. 
In Zhuk [2005a, 2006c] I applied GKD to the case of the linear discrete-time DAE. 
As a final result, I obtained a new minimax recursive estimator for discrete-time 
DAE Zhuk [2004b, 2005a,c]. These results demonstrate the impact of the GKD for 
DAE models. In general, GKD extends the scope of the classical MSE framework, 
originally designed for linear models with bounded invertible operator and bounded 
uncertainties, on the linear models with unbounded non-invertible operator and 
unbounded uncertainties. This brings the following advantages: 1) possibility to 
construct minimax state estimation algorithms for Differential- Algebraic Equations 
(DAE) and 2) possibility to address the case of unbounded model errors. 

Dissemination of the new results. The generalized Kalman duality concept 
and minimax state estimation algorithms for linear DAEs were published in the 
sequence of papers Zhuk [2004b, 2005a,c,b,c] and was reported at the confer- 
ences Zhuk [2004d, 2006a,b]. Also the results were presented at the following 
seminars: "System analysis and decision making theory" and "Modeling and op- 
timization of uncertain systems" at the National Taras Shevchenko University of 
Kyiv, "Non-smooth optimization" at the Institute for system analysis at Kyiv Poly- 
technic University, "Optimization of controlled processes" at Glushkov Institute for 
Cybernetics at National Academy of Science of Ukraine. 

Connections with national research programmes. The dissertation was 
funded by the National State Research Programme 01SF015-01 "Development of 
the theory, algorithms and software for stochastic and algebraic systems with ap- 
plications in economics, engineering and education" (state registration number is 
0101U002173). 
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2 Summary of the dissertation 



Notation. E denotes the expected value of the random variable, 

denotes the n-dimensional Euclidean space, 
(•, ■)n denotes the canonical inner product in R", 
tiQ denotes the trace of the matrix Q, 

y = {yo . . . yN) denotes a vector composed by elements . . , y^^, where yi also 
may be a vector, 

L2([a,c],R") denotes a space of square-integrable vector- functions on [a, c] with 
values in R*^, 

W2([a, c],R") denotes a space of absolutely continuous vector functions on [a, c] 
with values in R", 

%* denotes the adjoint of the linear mapping "H, 

B' denotes the transposed of the matrix 5, 

^(L) denotes the domain of the linear operator L, 

II • \\x denotes the norm of the normed space X, 

(•, •) denotes the csnonical inner product in the Hilbert space H . 

Outline of the dissertation. The dissertation is composed of three chapters. 
The total number of pages is 140. The first chapter contains the general descrip- 
tion of the dissertation, its aims and basic notions. Also it contains the description 
of the state of the art in the DAE literature, a brief overview of the state esti- 
mation methods and description of the new results. The second chapter describes 
the generalized Kalman duality concept and minimax state estimation algorithms 
for linear DAE with discrete time. The third chapter contains the generalized 
Kalman duality concept and minimax state estimation algorithms for linear DAE 
with continuous time and conclusions. 

Brief summary. Let us consider the contents of the second chapter in brief. Let 
X e R*^ solve a linear algebraic equation 



where F is m x n-matrix, B is m x ]3-matrix, H is / x n-matrix and 77 is a realization 
of the random /-vector, x denotes the state of the system (1), / G R^ represents an 
uncertain element. 

We will assume that / and =^ E?7?7' are uncertain and 



Fx = 5/, 
verify 
y = Hx + ij 



(1) 



and let the observed data E R' 



(2) 



feW,R„e% 
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where ^, ^2 are given subsets. In what foUows we will be looking for the estimate 
of the hnear function x 1— > ^{x) = {£,x)„,£ G We will look for the estimate 
in the class of affine functions y {u,y)i + c of observed data (2). We will refer 
(w, y)i + c as an estimate. Let us assign to each estimate Uc an estimation error 

a{u, c) = sup{E[(^, x)„ - {u, y\ - c]^\Fx G R, G ^J, 

where B{^) = {Bf\f G W}. 

Definition 1. The estimate {i^x) = {u^y)i + c verifying 

a{u,c) = infsup{E[(£,x)„- {u,y), - c]'^\Fx G B{W),R„ e %} 

U,C T> 

is called a minimax a priori mean-squared estimate (a priori estimate). The number 
= infy^c (^(i*? c) is called a minimax mean-squared error (a priori error). 

Let us consider an a posteriori state estimation method. Let x eW^ verify (1) and 
G is given in the form 

y = Hx + g, (3) 

where g G is a vector. In contrast to the previous considerations, we assume 
that (/, g) are deterministic and belong to the given set ^ c R^ X R"^. Define 

X ={x eW'\3{f,g)e^:Fx = Bf,y-Hx = g} 

Definition 2. The estimate i{x) verifying 

sup \i{x) — i{x)\ = inf sup \i{x) — i{x)\ 

is called a minimax a posteriori estimate (a posteriori estimate). The number 

(7 =^sup \i{x) — i{x)\ 

is called minimax a posteriori estimation error (a posteriori error). 

The a priori and a posteriori estimates are constructed in the dissertation for the 
generic convex compact bounding sets ^, ^2- Let us consider the case of ellipsoidal 
bounding set in more details. 

Theorem 1. Let 

W = {fe RKQJ,/), ^ 1}, = {R, : trQ^R, ^ 1}, 
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where Qi, Q2 are positive definite symmetric matrices. Then the minimax a priori 
estimate of the linear function 

X ^ {£, x)„, £e^ ={£ = F'z + H'u, z G R"\ m G R'} 

of the solution of Fx = Bf has the following form 

{i,x) = {u,y)i, u = Q2HP, 

where p solves 



Fp = BQ;'B'z, 
F'z = i- H'Q,Hp. 



The minimax a priori error is given by 



supE[(^,a;)„ - {i,x)]'^ = {£,p),. 



1 / „ X 1 



(4) 



If £ ^ ^ , then the minimax a priori error is infinite. 
Theorem 2. If £ e ^ and 

^ = {(/,5):(QJ,/).+ (Q2^,^). ^1}, 
then the minimax a posteriori estimate is given by 

£{^) = (£, x)„ = {Q,Hp, y),,a=[l-{y- Hx, Cl,y)^^{£,p)l 

and the minimax a posteriori error is given by 

a=[l-{y-Hx,q,y)},^{£,p)i 

where p solves (4) and x solves 

Fx = Bq-'B'p, 

F'p = H'q,{y-Hx). 

If i ^ then the minimax a posteriori error is infinite. 

Let us demonstrate one application of Theorem 2 to the state estimation for the 
linear DAEs with discrete time. Assume xq . . .xn is a solution of the DAE with 
discrete time: 



Fk+iXk+i - CkXk = Bkfk, Fqxq = Sx1^,k = 0,N 



(5) 



and the observed data is given by 



(6) 



are 



Yk = HkXk + gk, k = 0,N 

where F^, C/t, S are m x n-matrices, Bk is a m x j9-matrix, fk G R^, Xq G 
some vectors, Hk is / x n-matrix and gk G stands for a deterministic noise in the 
observed data. Define a linear function 

N+l 



fc=0 

where £ := (4, • • • , £n+i) and x := {xq . . . xn). Define 





F = 



Fo 

-Co Fi 

'o 'o 





—Cn~i Fn . 



, H = dmg{Ho . . . Hn}, B = diag{5o . . . ^^v-i} 



and set y := {yo . . . yN), f ■= (xq, /o • • • /tv-i), g ■= {go ■ ■ ■ gN)- It is easy to see 
that Fx = Bf is equivalent to (5) and y = Hx + 5^ is equivalent to (6). Now we 
apply Theorem 2 in order to derive the minimax a posteriori estimate of the linear 
function (£, x) in the variational form. 

Theorem 3. Assume that i = (^i, . . . , iN+i) is such that Fj^^j^z^v+i = ^n+i CL^d 



F^Zk - C'f.Zk+1 + HkUk = £k,k = 0, N 



for some Zk and Uk, k = 0, N. Assume also that 

N 

^ = {(/. V) : (Qo4, + ^(Qi,,//fc, fk)m + (Q2,/cVfc, Vk)l ^ 1}, 



k=o 



where Qo, Qi,fe, Q2,/c a^e positive definite symmetric matrices for k G [0, A^]. Let 
{pk,Xk) solve 

Fk+iXk+i = CkXk + BkOtllB'^pk, FqXq = ^Qo'^'^o, 

^'kPk = G'kPk+i + Hl.Q2,fc(yfc - ^kXk), K+iPn+i = 0, A; = 0, iV 

The minimax a posteriori estimate of the linear function Ylk^oi^k, Xk)n has the 
following form 

^ _^ iV+l 

{£,x) = ^{ik,Xk)i = ^{Q2,APk,Jk)i- 

k=0 k=0 

The minimax a posteriori error has the following form 



N 



N+l 



^ = [I- ^{jk - ^kXkM2,kyk)i]' C^ih,Pk)iy , 



k^O 



fc=0 



where pk solves 

Fk+iPk+i = CkPk + BkCl'llB'^Zk, Fopo = scions' zq, k = 0,N. 



F' 7 — f 



Consider the minimax a posteriori estimates in the form of filters. 

Theorem 4. Let = E and assume that the columns of the block matrix [ ] 
are linear independent for any k = 0^ N. Then for any i E the minimax a 
posteriori estimate of the linear function {£,xn),, by observations y^.-.y^ in the 

form (6) has the following form {i,XN)„ = {i,X]sf\N)„, where Xk\k can be computed 
using the following algorithm: 

Xk\k = Pk\kF'k{Qi\^i + Ck-iPk-i\k-iC'k-i) "^C'fc-i^fc-i|fc-i + Pk\kHkQ2,kJkj 
Pk\k = {^'k{Q\\-i + Ck-iPk-i\k-iC'k-i) + Hj^Qa.fcHfc) , 
-fo|o = + HQQ2fiHo) \ xo\o = Po|o-^oQ2,o2/o, 



Let us consider the contents of the third chapter in brief. Assume that the state 
x{t) verifies the following DAE 

j^Fxit)-Cit)xit) = fit), (7) 

and 

Fx {a) = fo (8) 

where F is a m x n-matrix, C{t) is a m x n-matrix with continuous on [a, c] elements, 
t I— > f{t) G is a vector-valued function from L2([a,c],R™) . In order to define 
the solution to (7) let us define a linear mapping x i— >■ Vx G La ([a, c], R™) x R"^ by 
the following rule 

^{V)={x G h,{[a,c\,W) : Fx G W^[a, c], R"^)} = W^p([a, c], R"), 
Vx = (-^ Fx{t) - C{t)x {t),Fx{a)), xe^{V). 

Let /=(/,/o) G U{[a,c],W) x R™. Then x (t) is a solution of (7)-(8) if 

Vx = f. (9) 

It was proved in the dissertation that T> is closed dense defined linear mapping 
and its adjoit was calculated. The minimax state estimation theory for linear 
DAEs in the form (7) can be constructed applying the same ideas as for the linear 



9 

algebraic equations (1) presented above to operator equation (9). This approach 
will be presented below. 

Assume that x solves (7) and observed data t i— > y{t) G M} on [a, c] is represented 
by 

y{t) = Y{{t)x{t) + T^{t), (10) 

where H(t) is continuous / x n-matrix on [a, c], t i— > riit) G is a realization of 
/-vector valued random process with zero mean and continuous correlation function 
R^(^, s) = Er]{t)r]'{s). Define a linear mapping 1-L by the rule Hx (t) = H{t)x{t). 

Let us consider a priori minimax estimates. We assume that the initial condition 
/o G R"^, input / G L2([a, c], R"^) and correlation function {t,s) i— > R,y(t, s) are 
uncertain and belong to the given bounded set, that is: 

As above we will look for the estimate of the linear transformation of the solution 
x{t) of (7): 

l{x)= f\£{t),x{t))^dt, £GL,([a,c],R^) 

J a 

by means of the linear function u of observed data 

Uc(y)= / {u{t),y{t)),dt^c, uGL,([a,c],R%cGR. (11) 

J a 

We will refer the function of observation in the form (11) as an estimate. Let us 
assign a worst-case estimation error 

(j(u,c) = sup{E[^(x) - Ue(y)]^|Px G ^,R^ G W,} 

The worst-case estimation error measures the quality of the estimate u and it does 
not depend on the particular realization of the uncertain parameters (/o, /, R,^). 

Definition 3. The estimate Uc verifying 

a{u, c) ^ sup{E[£{x) - Uc{j)f\Vx G ^, R,, G = o"(m, c), u G c G R 

is called a minimax a priori mean-squared estimate. The nwm6er (7 =^ infuse c(u, c) 
is called a minimax a priori mean-squared error. 

The following propositions present the algorithms for calculation of a priori esti- 
mates and errors in the variational form for the case of ellipsoidal bounding sets. 
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Theorem 5. Let 

^ ={[/,/o] : (Qo/o,/o)™+ f mJXAi ^ 1},^/={R, : rtr(Q,R,)dt ^ 1} 

J a J a 

where Qi,2(^) cl'^g. symmetric positive definite mxm-matrices, Qi^2(^) continuous 
on [a, c], Qo is symmetric positive definite m x m-matrix. Define a linear operator 
by the rule: x i— > T^x = Co, where u is a unique solution of the following 
optimization problem 

||(zo,z,u)||q-i = (Qo'zo,zo)„, + / (Q^'z,z),„ + (Q2"'u,u),dt ^ inf , 

(zo, z,u)eW ={V*{zo, z) + n*u = x} 
Then the minimax a priori mean-squared estimate is given by 

Uc{y) = {T^^^ (0,y))L™><4 = (w,y)4, 
and minimax a priori mean-squared error may be represented as 

a = a{u) = WrnWl-, 

provided 

£eR{r) = {V*{zo, z) + n*u, (zo, z) G ^ {V*),u G L,([a, c], R')} 
Corollary 1. If the set R(T) is closed, then 

u{t) = Q,it)Rit)pit), aiu)= I (£(i),Kt))Rndt, (12) 

J a 

where p solves the following two-point boundary value problem 

^F'z{t) = -C'{t)z {t) + B'{t)Cl,{t)B{t)p{t) - F'z(c) = 
at 

^ Fp{t) = C{t)p{t) + Q;\t)z {t), Fp{a) = Qo^(FF+z(a) + d),F'd = 



(13) 



The next proposition represents a way to approximate the a priori estimate u by 
means of Tikhonov regularization approach. 

Theorem 6. Take at > and letpk, -^fc, dk denote a unique solution of the following 
two-point boundary value problem: 

^Fp{t) = C{t)p{t) + akQ;'{t)z{t). Fp(a) = akQo\FF+z{a) + d), 

d 1 (14) 

- Y'z{t) = -C'{t)z it) + (E + —}l\t)Q,m{t))p{t) - i{t), F'z(c) = 0, 
at c^if 
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Then 

ieR (T) ^ ||ufc - ^11' + \\zk - z\\l^ + \\FF+Zk{a) + 4 - io|||™ ^ 0, 
where zq = FF+z{a) + d, Uk = — QzHpfc. 

Let us present minimax estimates in the form of filters. 

Theorem 7. Assume thatt i— > K{t) solves the following descriptor Riccati equation 

^(FK(t)) = C{t)K{t) + K'{t)C'{t) - K'm'm,Uit)K{t) + Q;\ 
FK(a) = FF+Qo'FF+, 
on [a, c] an^f 1 1— > verify the following differential- algebraic equation 

4 F'z(t) + C'(t)z (t) = H'(t)Q,(t)H(t)K(t)z (t), F'z(c) = 4- 
at 

T/ie a priori minimax mean-squared estimate may he represented by 

J a 

and the a priori minimax mean-squared error is given by 

a={FK{c)F+'£o,F+'£o)„^. 
Let X denote a solution of the following linear differential-algebraic equation 

^ ¥x{t) = C{t)x{t) + K'm'm,{t){y{t) - H(t)f (t)), 
at 

Fx{a) = 

Then the a priori minimax mean-squared estimate is given by 

{£i^c)) = {Fx{c),F+'£o)^. 

Definitions and representations for the minimax a posteriori estimates are given in 
the dissertation. 

Conclusion. The dissertation presents a generalized Kalman duality concept 
and minimax state estimation approach for linear differential-algebraic equations. 
The key results of the dissertation are as follows: 

• generalized Kalman duality concept; 
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• new definitions of the minimax estimates based on the generahzed Kalman 
duaUty concept; 

• new variational form of minimax state estimation algorithms for linear DAE; 

• new minimax state estimation algorithms for DAE in the form of filters; 

• efficient description of the reachability set for DAE; 

• description of the uncertainty propagation by the DAE; 
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